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A prima ryi concern affecting the more than 300 
American Indian tribes and their educational institutions is the 
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HOPI 1 

Hakiy liaav lavayi'at~ oqala' atningwu. 

One's own language is one's ^strength. 



PAPAG" 



Pi 'att hekid o sa'i hebhu 
pi si has 'elid c'epfhekaj. 

I 



7 

wjja g t-fli'< 



bki fl-ac 



We will never lose our language because we 
respect and "use it. « 



WHITE MOUNTAIN APACHE 

Dzil Ligai Si'ari biyati'i beyashtfhtf b'igh^ beda'bshdlri. 
Dn yati' d^nxhonehij dawa jft shit'eke' la'n shik'n bit 
HcH'i' yadahilti'. Dadn yati'n zh^' nh'Mgq <in Dzk 
tigai .Si'ariyu riohwiiif denzh6ndhn benajgoch/ildi''. 
Du yati' denzhdnehu aldo' behach'ido'aal, Na'ff eesyu 
ndih. ta'n nohVinilm dagodnls^hgo yee dado'aat. 



I am proud that I can speak the White Mountain Apache 
language. It is a beautiful language that I use daily to 
communicate with my friends and relatives. It is the 
only appropriate language that you can use to describe * 
the beauty of , our land here in the White Mountains. 
This lovely language' can also be used in singing, as in . 
the Sunrise Dance. Many songs show -respect to our land. 



HUALAPAI 



Hwalbaych yujim nyi yujik Hwalbay gwe ga 
nyu wij nyoch Hwalbay nya gwawjim 
vilvyjkyu du gud hal yuwk Hwalbay gwawch 
ba nyi e:jim nyu yum jgoyuja yivch yu ' 
Hwalbay gwe nyi yujiya nya gwqjvch vach gwe 
nya yujiva bay gijnajk gan^vki dinyjid ,u:k 
haygu gwawk haygu gwe wijiya spo:j yid gak , 
nya gwawch va wahyaja yivch yulv dopkyu. 



NAVAJO 

Dixit bizaad'df nitsihikees, nahat'ah, iina, 
d66 siihasin 6hoo'aah at' 6h. 



Learning the basic processes of the Navajo 
language invplves thinking, planning, 
reasoning, and setting goals for the essence 
of life within the individual. ' ■ 



The Hualapai language is a vital part of the 
people's lives: the language is an inseparable 
part of our traditional and contemporary life. 



ARIZONA INDIAN RESERVATIONS AND LANGUAGES 



UTAH 





9. Pay son- 

i *Tonto Apache** 

\ 

11. Fort McDowell- Yavapai 

13.Salt River-Pima v rt \* 4 
Maricopa VJj '* V 




12. Fort Apache- Apache, 



» 

^^19. 
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1 6. Gi la 8end-Papago 1 7. JGiJa tiivef-Pima, Maricop* 



15. Fort Yuma— Quechan 



Cocopah-Cocopah 



N O PTH 




J. Kaibab— Paiute- 

2. Navajo— Navajo 

3. Huaiapai-Hualapai 

4. Havasupai— Havasupai 

5. Hopi— Hopi 

6. Fort Mojave— Mojave* 

7. Yavapai-Prescott— Yavapai 

8. Camp Verde— Yavapai-Apache 

9. Payson— Tonto Apache 

10. Colorado River-Mohave*, Chemehuevi 

11. Fort McDowell— Yavapai 

* Distinct spelling for reservations 



1 2. Fprt Apache— Apache 

13. Salt River— Pima, Maricopa 

14. San Carlos— Apache * 
J 5. Fort Yuma— Quechan 

16. Gila Bend— Papago 

17. Gila River— Pima, Maricopa 

1 8. Ak-Chin— Papago, Pima 

19. Cocopah-Cocopah 

20. Papago— Papago . * 

21. Pascua Yaqui— Pascua Yaqui 

22. San Xavier-Papago % v 
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PREFACE . 

The twentieth century American Indian* people, no matter how small or how 
large - the linguistic group, seek to preserve or revive their native 
languages. With this realization, the Arizona Department of Education, 
Bilingijal Education Unit, and the other participating organizations whose 
conderri and priority lies in the best,intere&t of this effort, is providing the 
American Indian Language; Proficiency Assessment; Considerations and 
Resources. It is the hope and understanding of the contributor's to this 
document that American Indian people will utilize this material as a rneans 
of constructing, modifying M and/or implementing an oral language 
proficiency assessment instrument for their own particular native 



language. 



a 

Appropriate language proficiency assessment instruments should be useful 
in assessing abilities of speakers of traditional American Indian languages. 
This would also extend to those language groups wfco are irMhe process of 
developing their writing systems with the goal to increase literacy capabil-' 
ities in the native language, of their respective tribal communities. It is 
stressed that an oral language assessment instrument should be designed to 
measure competencies of individuals with first language ability in an/ 
, American Indian language. 

It, is imperative ■ that the nature of language use be documented and 
assessed so that tribal members, especially the youth, can be assessed to 
a t scertaiii^hether they possess the native language skills consistent with 
the body of knowledge that the tribal communities wish to pass to the 
future generatiohs of tribal members. 

The Arizona: Department of Education and the other contributors to this 
document realize and assure all American Indian people that the -in for- 
mation in this document represents a beginning process and that^the body 
of knowledge in this field will continue to increase through additional study 
and research. With this acknowledgments comments and suggestions on the 
contents of this document are mcist welcome. ♦ 



INTRODUCTION 

American Indian spcietiej reach into antiquity— before the rise of this v nation. Throughout 
the course of historjr, American Indian tribes faced tr^nendous obstacles; yet today, in 
our modern society, the various tribal natipns * maintain their ancestral languages and 
traditions. In recognition of their status as sovereign nations, American Indian tribes ire * 

7 V 

developing greater skills and resources to'meet their specific needs. 

. :,. • ' • * . ■"• - 

Accorcjing to the 1980* United States Census Report, the .estimated population of 
American Indians is approximately 1,^18,225. There are some 300 triba^|roups within 
this estimated population, .each with its own language and heritage. Approximately 200; 
languages are being used in varying degrees by the tribes throughout tbp country. 

* ■••■••/». ..■ # * 

The State of Arizona has the third largest American Indian popu^ttion, estimated at 
152,857. California is ranked first wi^h an estimated population of 201,311 and Oklahoma 
is second in the nation with an estimated American Indian population of 169,^6*. 

In Arizona there are 17 diverse American Indian languages being spoken by the various 
tribal groups. The majority of the tribes have retained their language and culture. The 
1981-82 Annual Report of the Superintendent of Public Instruction from the Arizona 
Department of Education indicates that approximately 3*,966 Indian students attend 
public schools. Statistics further show from the Arizona Department of Education's 1981- 
82 Primary Language Census Report that of the 3*,966 Indian students, 21,660 indicate a 
primary ^language* other than English. This does not include the approximately- 13,600 
other Indian ^students who donot attend Arizona public schools. The alternate educational 
institutions serving .these Indian ptudents ar^sjhe Bureau 6f Indian, Affairs boarding and 
day schools, church-related mission schools and Indian-controlled schools with support, 
from P.L. 93-638 Indian Self-Determination Act,^ Johnson O'Malley; P.L/92-318 Title IV- 
A, Indian Education Aqt; P.L. 95-561 Title VII Bilingual Education Act; P.L. 81-87* Impact 
Aid; and additional federal and private sources. 

A primary concern affecting American Indian tribes ^nd their educational institutions is 
the s promotion, maintenance, an? preservation of their native languages. Bilingual* 
education programs are expanding in the area?* of curriculum development* parental 
involvement, and language policy development. These programs are also acjdressing the 



ERIC 



need to develop appropriate language proficiency assessment instruments for native 
speakers. - * \ * J 

: - . • 

With* tribal interest increasing in'language renewal and maintenance^ it is imperative that 
individuals working in the fields of education,* linguistics^ ahd^jsychology be cognisant- of 
the various areas of involvement. • One important ared is the assessment of proficiency in 
the tribal language. An American Indian language must 'have some instrument or 
procedure to-accomplish this. \* ^ 

Many language assessment instruments are currently available and considered reasonably 
„ valid. However, there are a minimal number of instruments that are designed to measure 
languages based on different ways of organizing the world. For example, Indian languages 
have sound systems and grammatical forms that are distinct from those of the Indo- 
Eiuropean language tradition. T£e cultured and linguistic differences, of North American 
Indian groups are founded in ancient forms of communication unique to this , land. The 

* world view of American Indian linguistic families contrasts with that of Indo-European 
linguistic families. Current efforts in linguistic analysis arid language development of 
American Indian languages by various^ tribal linguistic groups reveal unique structure and 
depth in forms, of communication. A number of American Indian language institutes and 
conferences have been, helpful in these efforts as Indian people have worked with linguists 

\o expand their understanding of the structure of their ancestral, |Oral language traditions* 
as well as to develop their writing Systems based on their original tribal languages. 

As tribal languages become systematized through a standard or tribally-adopted writing 
system, then oracy, literacy and first-language 'proficiency assessment can become a 
-greater possibilityf the obtainmfent and analysis of data to measure student achievement 

can be realized; and greater gains can occur in educational development. 

/ ■' ■ . ■ 

* In developing useful instruments for American Indian language groups, orie' should consider 
a number of factors." American Indian languages are in varying levels of use within each 
linguistic community and in varying stages of development from the spoken ancestral 
tradition toward a written language. Few American Indian languages have been 
documehted_with regard to a developmental sequence of language acquisition among 
children. 



Another consideration is tKat the wealth of information, which is the richness of oral 
literature and tradition, is to, be found within the elders "of the community. This 
information can provide a body of knowledge oft the language itself as ^ell as the revered 
tribal traditions whiclvare primarily in oral form. ■>>.' "\ . ' ■ 

In addition to the above considerations, one must consider the relatively short history x>f 
American Indian languages being incorporated into the formal education (schooling) 
process, and that these languages have hot been analyzed according to the developmental 
stages of language acquisition." Although educators who* are themselves native speakers 
may be able to intuitively redognize what constitutes prof iciency in a speaker of > a given 
age, they may be limited in the structural knowledge/of their own language. 

x There is a need fdir knowledge of a student's actuai;native language proficiency. This 

information is important for: 

• * .* ■ * " **'*%• 

' ■ • J . . y : " . 

1) Improving program planning, placement and teaching strategies; arjd 

2) Meeting the growing interest among students and parents in maintaining, ' 
relearning and developing the native .language. * 

Many American Indian language _ groups have already begun developing language 
proficiency irtstruments. This document iis designed to help these groups refine their 
existing instruments afnd give direction to those who are beginning the process of 
developing new and appropriate instruments fdr assessing oral language proficiency-- 
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LANGUAGE ACQUISITION IN CHILDREN 

* • 

For centuries parents, scholars, and teachers have been fascinated and amazed by the 
phenomenon of language acquisition in children. Virtually every child, without special 
training, builds for himself or herself in a short period of time a deep-level, abstract 
and highly complex system of linguistic structure. In addition to acquiring the 
structure" of the language of his/her community, the child acquires the complex 
underlying rule system governing its use: how and when to say what , to whom 
(Lindsfor, 1980). 

> ■ • 

V 

To learn a language is to discover its system, or structure. Precisely how infants 
discover the structure of their native language is not known. But the structure can be 
defined, for all languages partake of the same defining characteristics, though a wide 
variation of the characteristics exists among languages. 

\ 

". The Children who are the subject of this document may have acquired the nativ 
language of their communty as a .first language and English as a second language upon 
entering the school system. They may have been exposed to both the native language 

^and English since infancy, with each language being used for different purposes. They 
may have been exposed to a linguistic system which draws elements from both English 
and the native language. The language of the local community may be used in a 
limitless number of variations. ^- 

For these reasons, it is essential, prior to establishing criteria for proficiency in the 
native language, to carefully document the use of the language among community 
• members. The general sequence of child language acquisition within the particular 
linguistic community must also be ascertained. Suggestions for these efforts are 
included on pages 18-19, Establishing a Language Data Base. * 



COMPONENTS OF LANGUAGE 

* • 

The essential characteristics of all languages can be listed easily enough. AH spoken 
languages possess a phonemic character, which means simply that in ever^Janguage a 
number of sounds (phonemes) are contrasted. Young children discover or sort out the 
sounds of theit f native language. ,Each languag^has a different set of phonemes or 
sounds conveying meaning, and each language arranges the phonemes in different units 
of meaning called morphemes, and children discover these as well. The native 
English- speaking child, for example, sorts out on some intuitive level, that ."walks", 
while a single word, consists of two units, walk and s. In doing so, the young child 
discovers the morphological structure of Jys/her language. The child ajso learns the 
phonological rules which apply to - mollify the basic forms of morphemes in 
combination. For example, the English-speaking child learns that the plural ending is 
v pronounced (s) following a voicetess consonant and (z) following a voiced phoneme, 
thus, (s) in cats but (z) in hands. 

f 

A third area of language which children discover is the syntactic system, or the 
grammar features, and the arrangement of morphemes. All languages have a form for 
indicating the nouns and the verbs, the acfor and the acted upon, the attributes of an 
object, the number of objects, actors, the possessor and the possession, the adjective 
and the noun. , All languages vary in how morphemes are arranged to convey trese 
meanings. Each language has its syntactical rules. Children appear to learn the rules 
of their language by interaction with othfer speakers. They attempt to make meaning. 
Much study haS^been done on this aspect of language acquisition, and it is recognized 
that grasping the syntax of one's native language involves generalizing rules. Often 
the child overgeneralizes, but, before^ doing this, the child simplifies the rules 
(Macaulay, 1980). In English, for example, a child says "Mommy working" long before 
he/she uses the auxiliary verb, "Mommy is working." T\n example of over- 
generalization irt English often quoted, because often heard is "I goed." The young 
child using "I goed* has internalized a set of rules which utilize the ed morpheme to 
indicate the past tense. "I finished the picture. I goed out," the child says with perfect 
logic. * » 



Ahothej aspect of language structure which all languageVstems share is often called 
semantic^ the meying of selected words. It is an aspect "that has, for centuries, 
commanded the attention of philosophers. It appears that meaning is. subjective and 
tied to experience and growth. And in the discipline of child development, it is quite 
safe to say that words, in any language, often do not mean the same to a chilli as they 
do to an adult. This is so because the young child's means of categorization and 
generalization are limited, developing through experience. Macaulay (1980) speculated 
that, in English, the reason why children often say finger for thumb at a relatively late 
age is that thumb is a harder sound to master, and so many children simply will not' 
make the distinctions. That meaning is not always quickly mastered, even on simplest 
levels, is evidenced by the stages ppany children go through in corif using "before" and 
"after" and "ask" and "tellMMacaulay, 1980). 

Evfen older children who might be expected to come closer to the distinctions in 
meaning which adults make, reveal semantic differences regarding everyday words. 
Again, Macaulay (1980) notes some .examples: ^ 

Adult: What is a brother? 

' i' 

Child: A brother is a boy. 

Adult: (seeking to aid) What do you have to have to be a brother? 

Child: , Pants with pockets. 

v.* 

Meaning is often tied to syntax* and studies have shown that certain grammatical 
constructions cannot be understood by young children. When a doll was shown with a 
blindfold over its eyes, the children were asked, "Is the doll easy to see?" The five-and 
six-year-olds consistently answered "no", and it was further noticed that many seven- 
and eight-year-olds also answered "no" (Chomsky, 1969). It is evident that children 
sometimes operate on different syntactic-semantic assumptions than adults. 

What we do know is that children sort out their native language and grow into all its 
features - the phonological system, the syntactic system and the semantic system. 
For most children the phonological system is the earliest mastered. The syntactical, 
tied as it is to semantics, an<J, both to cognitive development, is second. The semantic 
is a lifelong process, but, on its simplest levels, may be said to be mastered at the 
beginning of what Piaget ^alls formal thought. Language and thought then are 



intertwined. Language is related to human growth. The features of a language are 
inseparable 'from the human beings who learn and live and grow through that language. 



of a l/ngu 



Linguists have developed many models which explain and interrelate various elements 
Of language. . While most of these models have some common features, they also vary 
in one or more key ways. There is no universally accepted model of the elements of 
language. Models present ways to analyze language in psycholingurstic and feociolin- 
guistic parameters. If you work with linguists or other language experts, they may 
subscribe to one or more models. The. important thing is that models are presented to 
provide a working familiarity wi\h theories of the elements Qf language. They should 
* provide background knowledge needed to work with language experts to develop a 
comprehensive oi;al language proficifency assessment instrument. An example of such 
a model & shown below. « ' 

• • -FIGURE^ * • 

■■ - . - *V 

INTERRELATIONSHIP OF THE LANGUAGE AREAS 



LANGUAGE SKILLS 



Oral Skills 

r«c*ptlv 



Literacy Skills 

racaptiva / 




PHONEMES 
* (sound) 


GRAPHEMES 
(orthography) 




LEX 
(vocab 


CON 
Hilary) 






1 

SYNTAX 
(grammar) 






1 

SEMANTICS 
(meaning) 






H 

PRAGMATICS 
(languaga uaaoa) 





(Bordla 1970, MacNamara 1967; Coopar 1968; cltad In Cohan 1976) 

Note. From "Considerations for Developing Language Assessment Procedures", by 
Charlene Rivera and Maria Lombardo, Bilingual Education Teacher Handbook, 1982, p. 
*2. Reprinted by permission. . 
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DEFH^IONS OF PROHCffiNCY 



Proficiency may be defined in terms of an individual's linguistic and sociolinguistic \ 
competence and performance. This includes the degree of acquisition of particular J 
structures and rules within the phonological, morphological, syntactic, lexical, and 
semantic components, and the demonstration of this competence within particular 
settings. The speaker's internalized grammar is said to constitute, the deep structure , 
of the grammar or the speaker's competence and is distinguished from performance 
(speech production). Since proficiency can be quantified in terms of rule acquisition, 
it can be expressed in terms of a linguistic continuum. TfiUs, the acquisition of only a 
few rules of ^te grammar of language X would constitute minimal proficiency* A 
limited X-language speaker has a minimal proficiency ift a language. A fluent speaker 
has a high proficiency in the language; that is, he or she has acquired all the 
structures* has a broad range of foVms, expressions and lexical iteijis, and can use the 
language in diverse contexts. A fluent speaker is often described as proficient. 

Proficiency can be measured in terms of four modalities: listening comprehension, 
speaking, reading, and writing. This document focuses on oral proficiency. An 
illiterate person may be highly proficient in speaking and listening skills but lack 
literacy. A receptive bilingual, on the other hand, has developed only listening 
comprehension skills but has no oral or written production in the language. The 
proficiency of a student must be measured in relation to that of'his peers of grade and 
age level. A student may a/so demonstrate grammatical competence but be limited in 
terms of language use, for his or her proficiency may not be that of an adult. 
Proficiency also encompasses the ability to use the language in a variety of contexts. 
In the chart below is an example of a proficiency scale. It was adapted from the 
Foreign Service Institute by the Window Rock Unified District No. 8 in Ft. Defiance, 
Arizona, and has been used with Navajo students.* 

Proficiency Scale t 

1 - No Proficiency 

A rating of 1 indicates that the speaker cannot use the language in 
any practical way. The child may knovk a few words or phrases such 
as polite egressions, but is incapable of conversing meaningfully. 



\ 

Minimal Proficiency 

A rating of 2 is characteristic of speakers who know enough of the 
language to participate in routine interactions with teachers,* re la- 
tions,and peers. "Routine interactions 1 ! means expressing basic tjeeds 
and following simple directions. The child has a very limited 
vocabbl^ ry a nd makes many mistakes in gramrfiar. Utterances 
consist oTTingle words, phrases or rudimentary sentences; rarely 
extended discourse. It may difficult for others to understand 
unless they are well acquainted with the child. When -conversing with 
' this child it is necessary ttY^ise elementary vocabulary and simple * 
sentences; one must speak slowly, repeating or rephrasing often. 

Limited Proficiency • * , 

A child with a rating of 3 can be expected to converse with limited 
facility about concrete matters such as family, personal history, y 
travel, recreation, and school experience. There is an elementary 
grasp of grammar, but frequent errors may ^interfere with under- 
standing. Utterances - typically consist of extended discourse, 
although detail or elaboration is normally lacking; complicated sen- 
tence structures are only rarely employed. Vocabulary is adequate 
for nonspecializefl topics, but the child often hesitates and searches 
for words. Pronunciation is usually intelligible. It is sometimes 
necessary to speak to this child slowly and repeat or rephrase 
difficult points. - 

Basic Proficiency 

Ratings of * characterize speakers who can converse in social and 
classroom contexts with some degree of confidence. Basic grammar 
is well in hand, but errors occur when complicated structures are 
employed,^nd these errors sometimes interfere with comprehension. 
Utterances consist of extended discourse relating; detailfbr elabora- 
tion. The range of vocabulary is .wide enough to ensure" fair fluency 
in most instances. Conversing with this child does not' require 
inordinately slow, simplified speech or repetition * ■ ' . 

Full Proficiency » 
As the term "full proficiency" suggests, speakers with a rating of 5 
are able to use the language with sufficient fluency and accuracy to 
meet all social and academic needs appropriate to this pge group. 
Their powers of narration, description and persuasion may even 
indicate advanced development. Errors in grammar occur only in 
association with complicated structures and never interfere with 
comprehension. Such children are likely to have an elementary grasp 
of idioms and stylistics for that age level. For instance, play on 
words may be a staple of their humor. 
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The four linguistic skill modalities can be assessed in terms of this rating scale. 
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Listening Comprehension 
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Speaking * Reading 


•Writing 
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> Although assessment of reading and writing skills is , not addressed in this document/ these 
skills should not be neglected. Instruction and assessment of these skills could be Included in 
^%ch school curriculum where applicable. >■•*■.>■ ' 



EDUCATIONAL APPLICATIONS OF BILINGUAL MEASUREMENT 

The identification and diagnosis of bilingual students 1 linguistic background, perfor- 
mance, and environment are tasks that face countless, school personnel.. Dimensions of 
bilingual measurement would include: (1) ' language-prof iciency assessment, , (2) 
language dominance assessment, (3) home language identificatibn, and (*) primary 
language assessment (Burt and Dulay, 1978). the application^ these dimensipns of 
bilingual measurement is shown \h TSble 1 below. 





TABLE 1 

Educational Applications of Bilingual Measurement * 

. ... 


LINGUISTIC 
DIMENSION 
MEASURED 


APPLICATION 


LANGUAGE 
UUMINANUt 

i ; - ■ 


1. Bilingual program planning, including student and faculty assignment, 
z. Placement, in non-cngnsn or cngiisn meaium reaamg ana suujtici maiwr Classes. 
3. Initial diagnosis to determine language in which further testing is' to be conducted, 
v -4£" Progfamavaluation and needs assessment for funding. 
5 Cencuc rennrtina to the Office for Civil Riahts State Departments of Education, and 
other agencies. 


ENGLISH 
PROFICIENCY 


1. Placement in appropriate English instruction group. 

2. Determination of readiness to begin English reading instruction. 

3. Program ^valuation and needs assessment for funding. f 

4. Census reporting to the Office for Civil Rights and bther government agencies. 


NATIVE 

LANGUAGE 

PROFICIENCY 


1. Placement in appropriate native language instructional group. 

2. Determination of readiness to begin reading instruction m the native language. 

3. Program evaluation and needs assessment. 


HOME 

LANGUAGE 

USE 


'1. Educational planning, including choice of bilingual program model and determination 
of parental participation and assistance. 

2. < Determination of need to notify parents of school activities in non-English languages. 

3. Census reporting to the Office for Civil Rights, State Departments of Education, and 
qther government agencies. - 


PRIMARY 
LANGUAGE 


. 1> Censu* reporting to the Office for Civil Rights, State Departnfcnts of Education, and 
other government agencies. * 



Note : From "Some Gu idelines for the Assessment of Oral Language Proficiency and Dominance"- 
by M. Burt and H. Dulay, TESOL Quarterly 1978, 12, p. 181. Copyright 1978 by TESOL 
Quarterly . Reprinted by permission. J 



SELECTING, REVISING OR DEVELOPING ASSESSMENT INSTRUMENTS 



The following flow chart outlines the procedure for selecting, revising, or developing a native language proficiency assessment Instrument. These tasks shoutyte 
performed by a committee, whose composition Is described In step A. Basically, there'are three ways of arriving at a suitable instrurpent. In the first case, the school is 
already using an instrument which can be modified or'contlnue to be used as is. A second possibility Is the adoption, with or without modification,. of an existing 
instrument from anotfler source, e.g. another schooK The final optionls to a completely new Instrupnent. 

'■ • , • ' ' •• 
In the flow chart, procedures are represented by rectangles and decislon,polnts by diamonds; Lj refers to primary or first language. • 5 ' 
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■ -1 ' DESCRIPTORS * 

0 t i 

A. Form and orient committee to review the status of native language assessment ' 
within the school. ;The committee should Include at minimum a Hnguist, an 
administrator, a' test development expert, a teacher^ an aide, and- a parent. 
Insofar as possible, committee members should be proficient In the native 
language. J w . N ' • 4 » • 

0. Decide; . Are native language (Lj) proficiency assessjnen^ instruments being .. 

' used in the school? Ifcyes, continue with C. If no, proceed to I; • • \ 

» •, 

C, Evaluate the quality and suitability the instrument The information pon-* 
, tained on pages 10-15, Testing Considerations, should be hejpful. 

D, Deeide-,- Does the Instrument meet the standards outlined In Testing Consider* 
tions? If yes, continue administering the instrument as before, if no, continue 
to step E. • , , ' '. ' 

E, Modify the Instrument to meet the standards- outilnesd In Testing 
' Considerations. 



F. Pilot test the revised Instrument. 

G. Review and revise using Information obtained In F, 



\ 



H. Field test the revised Instrument, The Information contained on pages 31-35, 
Pilot Jesting, Field Testing and'Nprmlng the Instrument, should ft helpful. 

■ ' When a satisfactory Instrument Is completed, administer It within the\sehool. 

I. , Review native language proficiency assessment Instruments available elsewhere. 

J. Decide: Are any of the available instruments potentially useful? If yes, return 
to step C and review each Instrument which seems potentially useful, lino, 
continue to K. j • . 

K. Develop new instrument. The Information on pages 16-17, Guidelines for 
Developing New Instruments, should be helpful If you choose to construct a 
' new instrument. After the Instrument is developed, proceed to F, G and H. 

L. Administer the Instrument. This means administering the language proficiency 
assessment Instrument with the" appropriate American Indian population. 



* ' x TESTING CONSIDERATIONS 
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FACTORS IN DETERMINING THE APPROPRIATENESS OF TESTINGINSTRUMENTS 

A. CULTURAL APPROPRIATENESS 
* An understanding of the cultural base of the child and his/her family is 
important in planning an educational program and in the assessment of 
students who enter the prografa. The items should reflect the child's 



. cultural base, and represent the, major Categories of experience children 
•encounter in growing up. Some examples of cultural considerations include 
child rearing, * parental roles, religion, healing, treatment ; of animals, 
planting customs, etc. Less obvious are differenced between what th£^.\ 
school views as appropriate social behavior a!nd what traditional members 
Q'f the community view as socially appropriate. This may .include different 
approaches to modesty, respect, asking for help, offering help, and what 
topics are appropriate for conversation. For these reasons, the direct 
translation of test items is often inappropriate. 

Local people can beSt determine whether test items appropriately reflect 
the social* norms of the traditional culture. Items designed to test 
linguistic proficiency ^should represent experiences which ate common to • 
most children withiri; the. cultural group. Other specific attributes to 

corrsider are: * i ' 

• • 

1. j Appropriate cultural pictures which include background characteris- 

tics; 

2. The language terminology and relevance of topics; and 

3. Artwork which reflects the local environment as it exists, such as 
landscape, traditional and contemporary types of housing, dress, etc. 

B. AGE APPROPRIATENESS . 

Linguistic skills occur in the developing process, resulting in differing skill 
levels at different chronological ages. Assessment of linguistic skills, 
therefore, requires differentiating among chronological ages. A five-year- 
old may be judged to be proficient in his/her native language, whereas a 
seven-year -old with identical skills may be judged to be less proficient. 
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Assessment instruments must include items which are appropriate to the 
age levels of the target group. The criterion for various levels of 
proficiency may differ for differenfage groups. 



C. LINGUISTIC APPROPRIATENESS 
> To be a valid measure of tribal linguistic skills, a language proficiency 
assessment instrument must measure language* as it is used in the child's 
linguistic community. Very often this will mean that comparing the child's 
language use with some presumed "standard" may be inappropriate. Many 
American Indian languages do not*have documented language development 
sequences. v Therefore, intyitive knowledge* of local speakers concerning 
^>cal language "Usage should be tapped to develop items which represent the 
way language is used in the local community. > * % 



TECHNICAL APPROPRIATENESS . : x 

There are several criteria which should be considered >yhen judging the 
technical appropriateness of a native language assessment instrument. 
^ While no instrument dJh reasonably be expected to be perfect in all 
respects, gross inadequacies should r)Ot be. ignored or glossed over. Serious 
problems require modification of the instrument or selection of a different 
one. The following criteria apply when reviewing an instrument currently 
in use or when selecting^ language assessmeat instrument for the first 
time. 

CRITERIA FOR DETERMINING TECHNICAL APPROPRIATENESS 



Three questions that should pe addressed when reviewing an assessment instrument 

are: ^ \- 

1. Is the purpose clearly identified? Is it appropriate for the way the 

instrument will be used? 

- 2. Is information .provided abouTlhe technical characteristics of the instru- 
ment? Are thi technical characteristics acceptable for the proposed use? 



3. \ 



Is there adequate information about how the norms were established? Are 
the norms suitable for use with your students? - 
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These three questions are discussed further. 

1. the purpose clearly identified? Is it appropriate for the way the instrument 
wilfbe used? v 

Simply being labeled a language proficiency assessment instrument does not 
rftake an instrument suitable for all uses. The stated function of the instrument 
must be compared to" the intended use. Some instruments are designed to 
determine the individual's dominant languages Others attempt to rtieasurS 
proficiency in the native language or English or both.- These include instruments 
whifch attempt to place the student in one of the five categories of proficiency 
described, on pagesV5-6. Finally, others are designed to provide prescriptive data, 
i.e., information which can be used in designing the instructional program, 
planning curriculum/ making student placements or determining instructional 
grQuping. 

X If the stated purpose matches the intended use, then the instrument should be . 
examined to see if it actually measures what it is supposed to measure. Since 
not all instruments meet the ^laims made for them in the technical manuals, the 
actual instruments must be examined to see what aspects of language are 
assessedr^which domains are surveyed and what information is actually provided 
in ■ the ^reported results. 

2. Is information provided about the technical characteristics of the instrument? 
Are tfre technical characteristics acceptable for the proposed use? 

Technical characteristics include the reliability and validity of the instrument, 
as wgll as information about how the instrument was developed and field tested 
and how cut-off points between classifications were derived. TKe Criteria for 
acceptability in these areas are not clear-cut. Rather, judgments jjivolve 
carefully reviewing the information available, comparing it to the way the 
instrument will be used and making global .estimates of acceptability* It is 
important to note that an instrument may be valid for a particular use in one 
situation or with one group of individuals but may lack validity with other 
. population*. The following will assist in the review of the technical character is-. 
. tics. . * . .'■ 



What information is provided about the development and field testing of 
the instrument? Was it^d£Velop£d for use with individuals similar to the 
students with whorri it will b& used? Was it field tested on ^n appropriate: 
group of students? . v. • N 

What information is provided about faow cut-off points for placing students 
in different categories or levels were determined? Da they seem reason- 
able and realistic? Does an incorrect answer on one or twd items make a 
significant difference in an individual's placement? t 

What information is provided a^bout the reliability of the instruments Is . 
the reliability adequate for the intended use? Reliability describes how 
consistent the instrument t is, i.e., does it provide essentially the same 
Result ead>$me it is used? there are several types of reliability relevant 
to language assessment instruments: 

1) Test-rcftest - If a studept were retested within a brief timeframe 
using the same instrument, would the result be approximately tht. 
same? 

2) Alternate form (only applies Lf there ace two forms) - If a student 
were tested with both forms, would the result be approximately the 

• same? , . ' % *' 

3) Inter -rater If a % student were rated by two independent judges using . 
the same form or method, would they both provide Approximately thei*$ 
same result? 

*) Intra-rater If the same rater made two separate ratings, would the " 
results be approximately the, same? 

' *' / .■' . ' \ ■ 

What informatiori is provided to assist in assessing the validity of the test? 
Is the test vlalid for the intended use? Validity examines whether* the 
^instrument actually does what it is intended to do, i.e., does it measure 
what it is supposed to measure and does it provide accurate, Useful 
information. % ' v:.T' 
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The types of validity relevant to language prof iciency assessment instruments are: 

t) Face validity - Does the instrument , appear to measure language 
' ability? This Is important because many people may not accept the 
7 results if the test appears ta be measuring some other trait or ability. 

2) Content - Do the items on the test or observation form measure the 
\ : * ■ knowledge or abilities that are truly important for assessing language 

. / ability? Does it f»fer all (or at least roost) of the important areas as 

identified by resjirch and experience? What ■ types of items or 
questions are vised? What domains are covered? 

• <•':.■ ' ' ' ■' . 

3) Criterion-related - How do the results compare to those obtained 

:/ from other measures, of language ability, e.g., parent or teacher 

\*\\ ratings? The 4 instrument should provide .results similar to those 
m obtained .from different measures of |he same ability. Criterion- 

f elated validity. ris often reported as the correlation between the 
results on two different measures; 

' ' ■■■■■ \- 

..... * * • \ Copstruet - What is it that the test actually measures? Does it 
/ really measure language ability ^; .we understand it or do scores 

3. Is there adequate information about how the norms were established? Are the 
norms suitable for use with lotir students? 

r Norms are statistical information which .describe the distribution of scores of a 
well-defined population of individuals on a particiilar instrument. They provide 

! inforrpation about the level of performance of a particular individual or group of 
individuals relative to the def^ i.e., by comparing an individual's 

sCbre to the norms. yoU know how well he or she performed relative to that 
V particular group. With local norms, the norm group could be the students in a 
parties district; By establishing local norms, one can 

determine how well the individual performed when compared to the peer group. 



Norms can take many forms, e.g., an average score for each grade or school. 
However, the most frequently used procedure is to convert the raw scores into 
percentile ranks. A- percentile rank tells how well the student performed 
relative to the other students^in the norm group. For example, if a student has 
a percentile rank of J80 on a test, it means he or she scored as well as or better 
than 80 percent of the individuals who comprised the norm group. 

Norms are important because they allow you to interpret a score and make 
decisions based on the result. Often cutoff points are established; an individual 
whd scores above that point enters 9ne program while those scoring below it go 
into a different program.. As much as possible, these cutoff points should be tied' 
to the abilities or knowledge needed to perform in the program in question. In 
addition, it is important to remember that tests and instruments are not 
infallible. Placement should not be made on the basis of one score. The 
student's overall school performance and the information provided by parents and 
teachers should always play an important part in placement decisions. 

A detailed description of how to establish local norms is beyond the scope of this 
document. However, there are three factors to consider when examining a set of 
established norms or when constructing local norms: "1 

a. Definition and relevance of norm population - Is it clear exactly who is 
included in the norm group? Is this the group to v^j|p you want to 
cqmpare your^students? 

b. Procedures used to construct norms - Is the procedure for; deriving the 
^ norms from the raw scores clearly outlined? Does the information 

provided allow you to compare your students 1 scores to the norms? 

c. Usability of norms - Are they easy to read and interpret? Do they provide 
the information you need to make decisions? 
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GUIDELINES FOR DEVELOPING NEW INSTRUMENTS 

V . * ' 

A school may chbOse to develop a test locally because of various reasons. This task, 
should be undertaken only after considerable discussion has taken place regarding 
existing tests and the school's resources for test development such as adequate timd 
commitment of money, support, and technical expertise. < 

Test construction on a local ^level should only be undertaken when it is clearly 
understood that this will be significantly better than existing tests. 

A general set of procedures for language test development are given for management 
purposes only. 

2 

Instrument Development Procedures 

*\ . ' ~ 

A. Plkn the instrument. 

1. Begin tasks on pages 18 and 19 to establish the data base for the native 
( language. The more of this information gathered before the language 

assessment consultant arrives^ the further ahead the process will be. 

2. Make arrangements to bring in a test development expert and linguist, both 
of whom should have a knowledge of the tribal language and construction 

+ of language assessment techniques. 

h 3. Select testing approach(es) as listed, on pages 20-21 and. techniques for 
\ assessing language prof iciency as listed on pages 22-27. 

4. Establish probable length of time for assessing each pupil and determine 
the number of items in each area. I- 

5. Assign responsibility for writing items. * 

6. Determine desirefi test-scoring procedures (hand or machine) and the type 
of format of information required from the instrument. 

B. Write items. 

C Draft overall format including directions, user manual and scoring procedures. 
D. SubrrfFDtems and manual for review to: 

1. Persons knowledgeable in the native language and culture. 

2. Teachers of the grade ldvel for whicH* instrument was designed to deter- 
mine appropriateness for that grade level. 
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Pilot test the items in draft form. 
Jl. Select tryout populations. 

2. Administer a draft of the test to the tryout population. 
Analyze the pilot test data. 

1. Perform item analysis; delete inappropriate items. 

2. Determine how many items should constitute the final test, see pages 31 



3. ^ Determine appropriate time frames for test administration. 

4. Modify user manual, test directions, directions to'student(s) as necessary. 

Revise and assemble final forms. Determine the final format for test directions: 
test forms and booklets, user manual, scoring procedures, answer keys, sample 
items, user training materials. ■ Reproduce tests. 



35. 



Field-test the instrument. 



Document and analyze field-test data. 



1. 



Determine the reliability of the instrument. 



2. 



Determine the validity of the instrument. 



3. 



* Establish local norms. 



Continue revision and field-test cycle as needed. 
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ESTABLISHING A LANGUAGE DATA BASE 
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The following list provides examples of tasks which may l5e addressed by the 
committee to prepare for the development of the instrument. It should be stressed 
that committees may utilize the majority of these procedures prior to working with . 
linguists in the development of language assessment instruments. The tasks lead to 
the establishment of a general developmental sequence for the native language. The 
majority of these tasks must be conducted by speakers of the language. 

1. Observe and record oral language use within the community. 

2. Determine whether the native language has an orthography. If so, what 
documents and materials can be reviewed? 

3. Determine whether the native language is used for official and community * 
purposes. Is it written and/or spoken? 

4. Determine who reads and writes the native language. 

5. Determine whether X an official tribal language policy exists. 

6. Gather existing information on grammar and* vocabulary of thenative language. 

7. Gather language samples on all age groups, utilizing video and/or audiotapes. 
(Be sure to label tapes immediately by age/name/date as this has a bearing on 
the developmental stages of language. Refer to Language Sampling oA page 27.) 

8. Survey homes for primary language. The State of Arizona uses the following 
criteria to categorize a student as having a primary language other than English. 

a. The language most of ten spoken in the student's home is other than English, 
regardless of the language spoken by the student. — 

b. The language most often spoken by the student is other than English. 

c. The student's first-acquired language is other than English. 
.« - 

9. Develop teacher /teacher aide observation forms. ' 

a. What language(s) is/are used in the school? 

b. How is the native language used in the school? 

c. VHow many teachers/teacher aides speak the native language? 

d. ^ How many teachers/ teacher aides read and write the language? 

e. Hpw is the second language being taught? 

f. How and when do students use the native language at school? 
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10. Identify resource people within the community who are fluent speakers of the 
native language. 

11. Conduct discussion groups to 'determine how language differs throughout the 
community. .->' 

a. Usage (informatfnatural usage as compared with academic or formal usage) 

b. Differing orthographies whifch may reflect that an official orthography has 
not been adopted by the tribal council 

c. ' Variations in language usage across age groups Irom the younger \to the 
>i older members of the tribe ". 

d. * Variations in vocabulary or pronunciation within the linguistic group 
^ ^ according to geographic area 

12. Askchikfren io think of all the words they know on a topic. This would generate 
the frequency of Vocabulary terms. Record or write this information for possible 
use as test items which may "help determine the ^develop mental stages of 
language. 

13. Show students of various age groups different types of pictures. Ask students to 
comment on the pictures and record their comments. 

a. Action stimulus pictures - yield verb structure 

b. Position pictures - yield spatial relationships 

c. Description of a person - yield adjectives^ ^ 

d. Pictures of objects of various sizes and shapes - yield size relationships 

e. Name anything and everything from the picture - yield noun count 

1*. Show students, objects of various shapes and sizes. Ask students questions to 
determine their knowledge of relationships, (e.g. small, rrfedium, large) ahd 
, numbers. 
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LANGUAGE PROFICIENCY ASSESSMENT APPROACHES AND TECHNIQUES 

The dilemma facing developers of language . proficiency assessment instruments 
designed for use with children is how to get the child to say what he/she has the ability 
to say in the assessment situation. <, 

A number of approaches and techniques have been employed, which make use of studies 
that look at various uses of language Components. 

APPROACHES - >f~ - • 

Five of the most common testing approaches and their advantages and disadvantages 
« ...... 

are discussed below. The five are: 

\ . r 

Discrete point testing 

Discrete point tests select and measure particular items assumed to be represen- 
tative of a specific area jof competence. For example, a student's ability to 
correctly produce the past tense forms of the verbs walk, play, and want may be 
assumed to indicate that the student has internalized the rule for regular past' 
tense formation. A multiple-choice test could be constructed to assess the 
student's ability to select the proper tense at the sentence level, and a longer 
passage requiring the student to fill in the blanks could be used to assess the 
student's ability to avoid tense-switching within a paragraph. 

Comrrton examples of discrete point testing are multiple -choice and fill in the 
blank items; the former can be machine scored, but the latter provide more 
diagnostic information about the kinds of errors likely to be produced by a 
learner or a group of learners. These formats ace more useful for assessing 

«' itten than oral language. Discrete point tests are widely used in both 
mmercial and teacher-made instruments because they are easy to prepare, 
administer and score. However, since knowledge of a language is more complex 
than any sum of discrete items, discrete point tests do not measure overall 
competence in a language. 
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Integrated testing 

Integrated tests attempt a more global assessment by giving students the 
opportunity to produce original language samples in response to given stimuli; 
they are useful for assessing comprehension as well as production of oral 
language- Examples of integrated tests are answert^ questions, telling and 
retelling stories and writing compositions; they are more, time-consuming than 
discrete point tests and more difficult to score and interpret, but furnish a 
broader base of ^formation. 

Direct-rating 

Direct rating instruments consist of a simulation of a realistic context for 
language use such as an interview or role playing. They are time-crifasuming, ; 
require' specialized training, and are difficult to score. However, thejy provide 
information about an individual's Command of the language an<J the general 
ability to communicate within a given context. 

Self -rating • 

Self -rating questionnaires provide data on the users' perceptions of their ability 
to function in a given language; they are easy to administer and s9ore. Their 
usefulness is limited. The value of self -fating is minimal with young children. 

Observation ** 

9 

Direct observation of language use in natural contexts such as the playground or 
the classroom provides important information about the language skills available 
to a student in a ^iven situation. This -approach requires a trained tester and a 
well-designed coding system, and is time-consuming and difficult to score. 

Language assessment planners need to be aware of the value as well as the limitations 
of each of the approaches. Provisions must be made to supplement the Information 
obtained from the language proficiency assessment administered. ^ 

■ " /<> . - 
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TECHNIQUES 

There are many techniques for testing the oral prof iciency of young children. Recent 

a 

studies show that there are a variety of approaches and techniques to determine or 

© 

measure language performance. Burt and Dulay (1980) affirm 'that of the four 
language skills, i.e., comprehension (listening), production (speaking), reading and 
writing, production is the more commonly used mode for determining the^linguistif 
dominance and proficiency of bilingual students* • * 
Most tasks used to elicit speech samples "or verbal responses may be grouped as 
(4) natural communication tasks or (2) liriguistic manipulation t^ks accordirtg to Jthe 
presence or absence of a communicative focus (Burt and Dulay, 1980). Tables 2 and 3 
explain the* tasks on the foMowing page. 

V m » 

t 

V ■ ' ' , . - 
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• TABLE 2 



Comparison of Two Major Types of Oral Language Elicitation Tasks: 
Natural Communication and Linguistic Manipulation 





NATURAL 
COMMUNICATION 


. LINGUISTIC 
MANIPULATION 


DEFINITION 


1 . Taps student's unconscious use of gram* 
maticai rules to produce utterances in a 
conversation. 

2. Uses natural speech where student's 
focus is on communicating something. 


1 Tonr etiiriont'c cnncpinuc ADDlicfltion of 

linguistic rules to. perform a non- 
communicative task. 
2. Uses artificial "speech" where student's 
focus is on a given rule. 


SOME TYPES 


Structured comrffunication, Non-structured 
communication, etc. (See Table 3) 


irnixaxion, iransiaiiun, \*uih}jiuiiuii, moms- 
formation, Substitution, etc. 


ADVANTAGES 


1. The language sample obtained represents 
natural communication, the skHI that is 
ultimately being assessed. 

2. The task is virtually free bf confounding 
task biases. ' 


1. Target structures seem to be readily 
obtained. . 

• ■ ( :■■ 

—— '"vO 


DISADVANTAGES 


Certain structures are, extremely difficult to 
elicit naturally, e.g., perfect tenses (had 
seen). 


Confouiids conscious knowledge and use 
of grammar rules with ability to use the 
language for communication; results in 
qualitatively different: language than com- 
munication tasks. 


TABLE 3 

Comparison of Structured and Non-Structured Natural Communication Tasks 




STRUCTURED 
COMMUNICATION 


NON-STRUCTURED 
COMMUNICATION 


DEFINITION 


• - 

Natural conversation between student and 
examiner where examiner 'asks student 
specific questions designed to elicit target 
structures naturally and systematically. 


Natural conversation between student and 
examiner or other person where there js no 
intent to elicit specific structures. 


ADVANTAGES 


Target structures roay be elicited selectively 
and quickly; more efficient than non- 
structured communication. 


Structures that are difficult to elicit with 
specific questions may be offered by' sub- 
jects spontaneously. 

: — % 


DISADVANTAGES 

s. 

4 


Not all structures are easily elicited, e.g., 
yes-no questions. 

» 


1. A great deal of speech must usually be 
collected before a sufficient range of 
structures is used by the student to per- 
mit assessment of linguistic proficiency. 

2. One cannot make any statements about 
the student's control over structures not 
offered during the collection periods 
(since one cannot be certain why a 
structure was not offered, i.e., whether 
the situation did not require it, or T whether 
the child did not know it). 



NOTE . From "Some Guidelines for the Assessment of Oral Language Proficiency and Dominance" 
by M. Burt and H. Dulay, TESOL Quarterly . 1978, 12, pp. 186-187. Copyright 1978 by TESOL 
Quarterly . Reprinted by permission. 
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The following are techniques for eliciting language through either natural communica- 
tion' or linguistic manipulation. In assessing young children, care must be taken to 
select items which assess language ability rather than conceptual development. 

Receptive Skills \ -n \. 

« 

1. Vocabulary ? 

The child will be shown a set of four pictures of objects and. asked to point to the 
one named by the; tester. The items, including the distrac tors, should be chosen 
among those likely to be familiar to the child. ' ; 

2. Identification of items by attributes - r m r . • 

a. The child will be shQwn a set of four pictures of familiar objects and asked 
to ^identify the one that serves a specific function, e.g*, the one you can 
eat, the one that flies; or has a specific characteristic, e.g., the broken 
one, the round one, the smallest one. 

b. Identification of items having spatial relation, to each other. The child will 
be shown a set of four [ pictures arid asked to identify -the one having a 
spatial relation to another, e.g., the cup next to the book. 

c. Identification of persbns 6t animals engaged in a particular action. The 
child will be shown a set of four pictures and asked to identify the one 
showing someone performing a certain action, e.g., the girl sitting down, 
while the distractors consist of a girl standing up, a boy sitting down, a dog 
sitting down., < - > * 

3. Performing a ^command or a brief chain of commands 

The child will be asked to touch a part of his/her face, body or clothing, torraiise 
his/her right or left hand- or foot, to pick up an item and give it' to the tester, or 
to place an item on top of or next to another; item. 
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Productive Skills t 

1. Vocabulary fluency. / 

The child will be asked to name as many items as he/she can think of that belong 
in a speqific domain; e.g., things to wear or things seen in the kitchen. A time 
limit should be set for each question. ^ 

2. ^ Sentence Repetition 

In sentence repetition tasks, the child is instructed to tjepeat exactly what is 
stated by the examiner. Once , the child understands thV nature of the .task, 
he/she repeats a number, of sentences, usually varying in length and grammatical 
complexity: * • . 

„ The technique of sentence repetition is -based on the theory that -a child does not 

merely mimic sentences in whatever forrp they are modeled, but rather repeats 

*>* them using his/her own linguistic rules. For example,, if the model sentence is 

t "He is going home," a child might say "Hirh going home" or "Him go.hqme."' 

^ The analysis of sentence, repetition tasks usually concerns syntactical develop- 

ment, often as compared to a standard of dialectical variety of a language or as 

■ " • .; .« * . . 

compared to language used by the child's peers. ^ Utterances may Jate^ 

analyzed at the sentence or semantic level and %he content may be dev^d^ed^tp 

| include topics from a variety of domains. / 

/ The most accurate scoring of such a test is obtained by taping the reisporisfeisj 
.The playbacH will furnish information ^n phonological, grammatical and vocafcu-- 
lary proficiency: A -response iri wjhich the child 4 gives the gist of the test item, 
but makes some acceptable changes, provides evidence 6t language processing 
ability apd shopd not be considered wrong. ■ VA skilled tefeter will be able to make 
useful inferences about the child's Stage of linguistic development on the ba$is of 
the kinds of coping strategies used. ^. ,V T.'- * / r . \ * .; 

Although a. some what artificial use of language, this technique tah provide 
information concerning a child's use of particular structures which may ript \.b<6^ 
observed otherwise. • V; 




Answering Question's - V . - 

The child will be asked appropriate questions about himself or herself and his/her 
experiences: The answers should be evaluated not only in terms of grammatical 
correctness but in terms of fluency and appropriateness. Another possibility 
consists of using pictures or objects and asking questions about them. 

Closure ;V V- '[ 

The child will be asked to finish ah incomplete sentence such as "It was cold arid 

the boy put on his .. V 1 ; p . 

Completing an unfinished story ... . J. , 

Thei; child ■ 5 v^aj j ?lje' shown a series of three -sequenced pictures repreMntiii| 

unfinished event, and asked to tell what happen^ he 4 s6. J ' "... . 
* • r '. ■ ' ' OV* -v ' £ ■ . - 

Retelling a story 

The child will be told a story and asked to retell it to the tester, or, preferably, 



to anoth^y person who was not there during the telling by the tester. 



Telling a story^ ; ^ ^ ■"'> \ 

The child wilijbe shown ,a series of pictures representing^a succession of events 1 
v and asked to tell what happened. > a 



Language Sampling 

■ • : n - 

r 

Language sampling is the collection of a variety of utterances from a child, which may 
be obtained in a more or less structured manner* The chilcJJs utterances' are often taipe 
recorded for later analysis. A basic assumption ! ot ; ? this - , 'teqK^uj^k-' : i9' that a 
^representative sample of the child's language skills is observed. Different settings 
have an effect ort£hildreiVs linguistic behaviors. A representative sample of a child's 
total communication abilities rnay require a sampling from more than one setting* ^ 
variety ^ of settings can be sampled, the child is permitted to produce and respond to 
language ;4n different domains. Obtaining a sample from a large number of children in 
a. specified manner would alldW comparisons of language used in , that . particular 
setting. V,.It would not necessarily provide information on language usage in other 
setting. ; « 

The methods of collecting samples are varied and; may include one or more of the 
following: • 1 v . \ 

1. Observation *of; the child in one or more .^j^ns, >e.g. f classroom, play- 
ground, home ' - 

2. Peer interaction which may be spontaneous or organized by the observer in 
someway , fy : '.v.' 

3. Teacher-child interaction occurring in a play situation. \ 
Teachers-child interaction using stimuli such as books or pictures , ' 

5. Story telling using wordless books 

6. Story retelling whc^e the child listens to a story and retells it 

Once a language sample has been collected it is possible to analyze it in a variety of 

«. *. "■>'•- 

ways. Offcen the language samples are compared to a predetermined standard. The 

standard may be adult speech forms qi the "standard" language pir adult speech forms 

ota particular dialect. It may* also include speech forms typicfally tased by peers of the 

same chronological age. •«£ » fc 



ERIC 




ADMINISTRATION OF INSTRUMENTS 



Administration procedures are dependent on the type of instrument used and sfciouli be. 
determined Ss part.of instrument; development. >To make valid assumptions concerning 
an;i^ usage and to make comparisons between children, standardiza- 0 

tibri must be maintained in test administration and in scoring. Therefore, those 
involved in the administration, scoring, and interpretation* of language proficiency 
assessment instruments should receive thorough training in these areas. The examiner 
: should be a native speaker of the language ,and, if possible, a member of the child's 
community with whom good rapport can be Established. 

Above all, neither the teacher nor the studertt should consider the Language proficiency 
assessment as a test, but rather as a vehicle for obtaining important information about 
the student and his or her language needs. . ♦ ' 

For instruments testing receptive language skills the following considerations are 
necessary: - • ,^jv 

1. . In what language will ttfe directions be given? * 1;. 

2. How will practice items be used? Can they be explained and repeated if 
the child answers incorrectly or does not answer at all? 

3. How will the examiner fe^nd to or score responses from the Child? 

* r 4. How will questions from the cfiild, including requesting repetition, be 

,i ,..;*h t 4ndled? . ;'; 

is " How /will responses be Scored so that the child will be unaware of incorrect 
responses? . 

6. Under what physical conditions will the testing 6c<;ur? 

For instalments including a child's ability to follow a series of commands the following 

considerations are riecessaryV £ 

' * *■ 

1. Will practice items be provided' and if* "so can they be repeated or 
explained? %. 

■ ■•. i ■ 

2y. m Does therdrder in whictf the command is performed matter in scoring? 

-■ , £U ( • v . 

3. May the examiner repeat%e command? 



For instruments .te$tinjg productive language skills the fallowing considerations are 
necessary: 

?■ \ . , ■"■ r • 

1. What techniques will be used?- ; ? 

) ' *-> ' 

2. How will the stimuli be presented? 

/ / . \.; ' 

3. How will thi child's responses be documented? Will a tape receding be 
necessary? ' - ~" 4 y • 

How will the examiner respond to the child's questions? 

5. May the exam$|^^^^^any part of the procedures? 

6. What aspects ottHe test Responses will be scored? £ 

7. What dialect will be acceptable? 

8. What should the examiner do if the child responds in English rather than in 



the American Indian language? 
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For observation, techniques the following considerations are necessary: 

1. In wfit environmental setting are the children to be observed? 

2< Which linguistic skills arii important for scoring purposes? 

3. Which scoring techniques will be used? 

What considerations will be given to children who exhibi/ limited verbaliza- 
,• tion? 

Mahy decisions about assessment liristVumeats. are probably made on the basis of rtheir 
feasibility, e.g., cost, ease of scoring or time required for administration. Whj^^roese 
factors are certainly impdrtant, the suitability of the instrument for the, particular 
purpose, the reliability and validity and the availability of appropriate norths should be 
considered first and foremost.22feA bad or irrelevant in^tVurnervt that is easy to 
administer, score and interpret may do more harm than gooai *On the other hand, jhe 
best instrument is of little v£Kie£if it can't be used or used properly due to logistical/ 
problems. " < k 

Some pf these* potential factors to be considered are: 

1. Cogt - How much will it cost r tO; develop the instrument and user's manual, 
and to administer and score the instrument? What would it cost to develop 
and norm an instrument specifically for your students? Remember to 
include the cost of any trained personnel needed to administer, score and 
interpret the'instrument. , 
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\ime - How much time is needed to complete a Valid administration? The 
value of the information obtained must be weighed against the time 
required to obtain it, for bdth ^he student and the school staff ... 
Ease of scoring and interpretation - Can individuals who speak and 
understand "the native language be trained to ad minister; score and 
interpret the instrument or will it require specially trained individuals? 
^ill^te^chers be able to understand and use the information provided by the 
instrument? Can it be machine scored or does it have to be done by hand? 
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PILOT TESTING, FIELD-TESTING AND NORMING THE INSTRUMENT 



Although constructing a language proficiency assessment instrument is certainly a' 
most important and difficult task, it is only the first step in developing a validated 
instrument that is ready for use. Test validation is the process of examining the whole 
test, as well as each individual item, to see how well the items assess what they, are 
intended to assess. Test validation can be divided into two parts, item analysis (pilot 
testing) which examines individual items, and field-testing, which examines the 
reliability and validity of the test as a' whole. 

One relatively simple way of judging the items on a test is tcf examine how students 
with varying levels of ability respond to each of the items. If the students can be 
listed in order, from those with the highest level of language proficiency to those with 
the lowest, this can provide quite a lot .of information about individual items. After 
the students have been rank ordered in terms of ability, and which ^students made 
correct or incorrect responses to each item recorded, the pattern of responses can be 
examined. On good items, the students* with higher ability should do as well as or 
better than the students with less ability. Any questions where ability does not seem 
to be related to. making the correct response should not be included on the test. Of* 
course, the results are rarely cjear-cut; generally the patterns of responses will be 
difficult to interpret. There are always some students who respond correctly when 
they would not be expected to know the answer and others who miss questions when 
they, would b^expected to know the correct response. This may be due to guessing, 
temporary lack of attention, carelessness or any of several other reasons. Whatever 
the cause, it increases the difficulty of identifying good and bad items. 

The other and perhaps most difficult problem is listing the students in order of ability. 
Sometimes this can be done by, having someone fluent in the native language interview 
some of the students who took the test and rank them in order of ability in the native 
language. ° 

Several fairly complex statistical procedures have been developed in response to these 
difficulties. Discriminating power, described in more detail below, is a statistical 
procedure which uses the overall score on the test as the measure of the students 1 
native language ability. Each individual item is compared to the test as a whole, 
instead of ranking the students through some outside means. It is assumed that 
students with the best overall ratingi>n the language proficiency instrument have the * 
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i highest ability and should do better oh any given question than students with lower 
ratings on the instrument. All of the statistical procedures for test validation require 
fairly complex numerical analysis and interpretation, thus they will usually require the 
assistance of an individual with, a background in nrfeasurement and testing. Also, since 
most statistical analyses a^dpne with computers, it may be necessary to have skills 
and access, to a computefis^ 

The information for the itenK^palysis is obtained by pilot testing, i.e. administering 
the instrument to a sample of the students with whom it will actually be used. The 
number of students included in the sample will depend upon the size of the target 
population and type of instrument. 

In any case, it is important for the sample to include students with wide ranges of 
a^ity as well as representatives of the grades for which it will ultimately be used. 
Item analysis examines two characteristics, item difficulty and discriminating power. 
With multiple choice items, the effectiveness of the incorrect responses, called 
dis tractors, is also examined. 

Item difficulty - The ajm of any instrument is to differentiate among plepple;according 
to how much they know or can do. Items which everyone gets rigtrt or ^ypAe gets 
wrong do not provide any information about the differences in ability among those 
taking the test. Therefore, items should be selected which some individuals get Tight 
and others get wrong. A good test item is one where students /who have reached 
certain levels of skill or knowledge will respond correctly, while /those who lack that 
knowledge or skill will not. Statistical item difficulty is actyajly the percentage of 
students who make the correct responses to an item. For flprnrt-r^ferenced tests, item 
difficulties of 30% - 7096T£re generally considered satisfactory.* Usually items which 
nearly everyone gets right or everyone gets wrong are eliminated from the test since 
they contribute little to its ultimate purpose. However, on instruments where you 
need to measure students with wide ranges of ability, such as language proficiency 
instruments, it is necessary to include some items .which are very easy and also some 
which are difficult for most of those who will be tested. 

♦The formula for calculating item difficulty CD.) is: * 

I.D. s number of individuals making correct response 
, total number of individuals who took the test 

Often this nuqiber is multiplied by 100 and reported as a number between 0 and 100. 
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In some cases, it may be desirable to include several easy items (i.e., those which 
nearly. everyone gets correct) at the beginning of the test to help students relax and 
build their confidence. f 

Discriminating Power - Discriminating power looks at who responds correctly to each 
item. A good item will discriminate between those who have reached a given level in 
the developmental sequence of language acquisition and those who have not. Students 
who have mastered the particular aspect of language being' assessed should respond 
correctly. However, we do not know which students have mastered each aspect of 
language (which is why we are assessing them). Thus, performance on each individual 
item is compared to overall performance on the complete instrument. Students wno 
demonstrate a high de^rep of proficiency on the instrument as a whole should be mote 
likely to respond cor irectly to any individual item. Only items where students with 
higher overall perfbrrtfaijck do better than students with lower overall performarure 
should be included in the instrument. - • , / 

Distra^abiUty - When /multiple fchoice items have a low difficulty or discriminating 
pbwferllt may-be helpful to examine the pattern of responses to determine possible 
* Causes "^ are often readily identifiable reasons for students^ 

picking a certain incorrect response (distr actor). Also, if no one selects a given 
distractor, it should be replaced With a more plausible choice. If students who are 
known to be proficient speakers of the native language frequently select a certain 
incorrect response, it often means the question is misleading or ambiguous or 
something about the particular distractor is causing the problem. In any case, the 
item should be improved ,or discarded. This is also true for any item with 
unsatisfactory item difficulty or discriminating power. Naturally, if items are- going 
to be discarded due to unsuit ability, it is necessary to include more items in the pilot 
test than are needed for the final version of the, test. 

After the unsatisfactory items have been discarded and the instrument arranged in its 
final form, it must be field-tested to estimate the reliability and validity of the test 
for its intended purpose. Reliability measures how consistent the instrument is, i.e., 
would students:, be judged approximately the same if they were administered the 
instrument two or more times. Validity examines how well the instrument does what 
it is supposed to do, i.e., does it really measure native language proficiency. 
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Reliability - Data from one or more field-test administrations of ithe instrument are 
used to calculate estimates*; of ^reliability. Reliability is usually reported as a 
correlation coefficient, which has a range of 0 to 1. For estimates of reliability, 
coefficients of .85 or better are considered to be very good ind around .70 generally V' 
considered to be satisfactory. Correlation coeificients are estimates of the degree of 
the relationship or how things "go together 1 ^ The larger the coefficient, the greater 
the relationship between two sets of data. 

For example, with ,test-retest reliability (see page 13 for a definition), a group of 
students is given the same instrument twice within a relatively- short period of time, 
usually less than two weeks. Since it is assumed that the students 1 knowledge has-. not 
changed too much between the first and second testing, they should get ^bout the > 
same score both times if the test is reliable. The more reliable the test ; the more : 
similar the student scores will be oh the two administrations. . " L : 

It is important to decide which type of reliability is most apprbpriafe and feasible 
before conducting the field-testing so that necessary data can be collected. A more' 
detailed description and definition of different types of reliability ar^|^given on pages , 
12-13. 

Validity - Validity, which examines whether or not the instrument actually measures \., 
what it is supposed to measure! is harder to estimate statistically and, therefore, ;is ( s . 
calculated less frequently. However, one method which provides useful information tsV 
to compare the results of the fielcMest with estimates of the native languag^biiity 
provided by the student's teacher, parents, or someone else who is fluent ^t^ ;^tiVf 
language. Hopefully, the test and this individual judgment will pro$i&^$ii 
estimates of the students native ability. A more detailed description and de^^^fol^. 
validity are given on pages 13-1*. 00 ^■/^%Vl%^ 

. « h y-W ? A. 
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Norms provide the information needed to interpret or give meaning to an individuals^ - 
score. The process of constructing norms involves two steps: ' - a 

1) Admihistering the final form of the instrument to a representative sample; 
of students which includes all ages and ability levels for whom it will be. 
used. * : 



2) v Converting the resulting raw scores to standardized scorestfe.g., percentile 
rahks), using a transformation based on the theory of the normal curve and 
the distribution of traits within a population. 

An individual's score can be compared to the scores from this norm group to establish 
his or her native language ability relative to other students of the same age or grade. 
In addition,. Technical Paper No. 7 by Wood and Tallmadge in the ESEA Title I ' 
Evaluation and Reporting System, "Local Norms", provides a more in-depth but simple 
presentation on the topic. 

Distinguishing ieatures of American Indian languages have beten emphasized related to 
the difficulty of designing tfibal language proficiency instruments. The development 
of norms for American* Indian language proficiency assessment instruments is a task 
which has been undertaken by few tribal language gri»yps. In Peach Springs, Arizona, 
r the .Hualapai Oral Language Test is currently undergoing standardization of data to 
establish their local norms. The reader is referred to ''Appendix C for further 
information on this instrument. 
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CONCLUDING REMARKS 

f 

In conclusion, American Indian Language Proficiency Assessment: Considerations and 
Resources has presented insights and guidelines for establishing viable instrumentation 
for assessing the oral language proficiencies of a unique population— American Indian 
children. » 

/ • . . ' ' ' 

Many considerations have been analyzed in examining what is involved in assessing oral 
native language proficiency applicable to tribal groups. It is hoped that school 
personnel, parents, and resource people involved will take care in examining the major 
aspects outlined in this guide in designing appropriate instruments for their students. 

Schools serving Indian students should, be cognizant of the following considerations* 

Native language profidenc)^j|^ssment is necessary in determining accurate 
placement and in designing appropriate curricula for Indian bilingual children. 
Such a process will enable schools to focus more effectively on the unique needs 
of Indian students. 

In concert with the Indian community, schools should develop a philosophy and 
policy statements which promote the improvement of educational programs and 
opportunities for Indian children with unique language and cultural backgrounds. 
A school committee will help this process. 

' The school committee should decide and select approaches which would best 
- assess native oral language proficiency of Indian students. This committee must 
' • . consider the numerous areas discussed in this document, including: 1) linguistic 
^ elements of *the particular language group, 2) appropriate testing standards and 
procedures, and 3) educational applications which would best serve the needs and 
backgrounds of Indian students. 

Native oral language proficiency assessment is a tremendous challenge.^ The intent is 
that strategies to meet this challenge; will result in improved education for children 
who deserve, a chance to benefit from relevant curricula with the assistance of 
„ appropriate language profidency^assessment. 

It is the hope of the contrib%ori*to this document that American Indian groups will 
utilize the American Ihdiah Language Proficiency Assessment: Considerations and 
Resources to work in coordination with schools to improve Indian education and to 
preserve what is inherently traditional. . > ; ^ ■ „ ■ 
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ARIZONA INDIAN LANGUA& RESOURCE UNGUISTS 



The following individuals have agreed to be considered as resource linguists within f tfeir 
own respective language family groups. * A„ ^ ^ 



Yuman Languages 

Ms. Lucille Watahomigie (Hualapai) 
Peach Springs Elementary District No. 8 
P.O. Box L38 
Peach Springs, AZ 86*3* 

Dr. Akira Yamamoto (Hualapai) . 
Department of Linguistics 
University of Kansas 
Lawrence, K$ 650*5 

Ms. Malinda Powsky (Hualapai) 

Peach Springs Elementary District No. 8 

P.O. Box 138 

Peach Springs, AZ 86*3* 

Ms. 3origine Bender (Hualapai) 

Peach Springs Elementary District No. 8 

P.O. Box 138 

Peach Springs, AZ 86*3* 

Mr. Edward Swick (Mohave) 
Route 1 ---Box 41 
Parker, AZ 853** 

Ms. lone Dock (Mohave) 

Tribal Education 

Routed -23-B * 

Parker, AZ 853** 

<> • , 

Ms. Mamie Harper (Mohave) 
Tribal Education 
Route 1 - Box 23-B 
Parker, AZ 8534* < . 

Dr. Susan Jasper (Mohave/English) 
136 Kenneth 
Camarillo, CA 93010 - 

Dr. Pamela Munro (Mohave) • 
Department of Linguistics >^ 
University of California - Los Angeles 
Los Angeles, CA 90Q24 y 



Dr. Leanne Hinton (Havasupai, Hualapai) 
Department of Linguistics 
University of California 
Berkeley, C A 94720 

Dr. Lynn Gordon (Maricopa) 
Department of English 
Washington State University 
Pullman, WA .99164 

Athabascan Languages 

Mr. Edgar Perry (White Mountain Apache) 

Apache Cultural Center 

P.O.Box507 

Fort Apache, AZ 85926 

*j > 
Ms. Faith Hill (White Mountain Apache) 
P.O. Box 1833 > 
Whiterlver, AZ 859*1 J ■ 

Dr. Ellavina Tsosie Perkins (Navajo) 
P.O. Box 479 
Ganado/AZ 86505 



^ Robert Young (Navajo) 
Departmenrof Linguistics 
University of New Mexico 
Albuquerque, NM 87131 

Ms. Irene Silentman (Navajo) 
Department of Linguistics 
University of Arizona - Math 203 
Tucson, AZ I571\j 

Ms. Allison Neundorf (Navajo) 
NAMDC 

*07 Rio Grande, N.W. 
Albuquerque, NM 8710* 

Ms. Lorraine BeGaye (Navajo) 
Navajo Language Department 
Navajo Community College 
Tsaile, AZ 86503 



38 



51 



J APPENDIX B (tontinued) 

Athabascan Languages (continued) 
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Dr.. Kenneth toale 
26 E - 225 . 
Massachusetts Institute; of Technology 
Cambridge, MA 02139 

Uto-Aztecan Languages 

Ms. Ofelia Zepeda (Papago) 
.department of Linguistics:; 
HJniyersity of Arizona - Math 203 
Tucson, AZ 85721 

"iffis. RosUda M. Manuel (Papago) 
Sah Simon Qa£ School 
Papago Agfciicy 
Sells, AZ 8653* 

C * 
Ms. Henrietta Pablo (Pima) 
Sacaton Elementary District No. 18 
P.O. Box 98 1 

Sacaton, AZ 852*7 : , 

Dr. Pamela Munro OPima), 
Department of Linguistics 
University of California - Los Angeles 
Los Angeles, CA 9002* 

Professor Donald Bahr (Papago, Pima) 
Department of Anthropology 
Arizona State University 
Tempe, AZ 85287 

Mr. Fernando Escalante (Yaqui) v 
Department of Linguistics 
Math 203 

University of Arizona 
Tucson, AZ 85721 

Dr. La Verne'M^ Jeanne (HopO 

Box 279 * ; 

Round Mountain, NV 890*5 



Mr. Milo KaiectaqaAHot>il 
BilingQal Education $erVic6 Center 
Arizona State .University 
Tempe, AZ 85281 

Dr. Edward Kennard (Hopi) 
785 Akard Drive 
Reno, NV 89503 

Dr. P, David Sea.man CHopi) • 
Committee on Linguistics . ■ ■ t; 
Northern. Arizpna University , « ' 

Box 15200 • ,« 

Flagstaff, AZ 8601 1 *f ; 

Dr. Wick Miller . 
-Uijiversity of Utah 
Department of Anthropology 
Salt Lake City, UT 8*112 

Dr. Kenneth Hale 
20 E-225 

Massachusetts Institute of Technology 
Cambridge, MA 02139 



General Linguist 

'■\Dr. William Leap 

■206,"G" Street, S.W. 
. Washington, D.C 20024 
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The Arizona department of Education, Bilingual Educatton Unit maintains a resource list oi 
additional people knowledgeable in the various language nmi^ groups. These people may be 
able to provide some, invaluable service to Ai^efB^ in jtreas sucjj^rt 

exploring the language in depth with a native ^rnqfc^jty 
language and /or exploring the language in an acade 



who is ; well-versed jftthe 
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AMERICAN INDIAN LANGUAGETAK INSTRUMENTS 




The following American Indian Language Proficiency Assessment Instruments have been, 
developed and are currently in use. They may be utilized. ,as samples for the local 
development of language proficiency assessment instruments. 



1. Hualapai Oral-Language Test 



1 



A*. : 



Cprftact person: 



Lucille Watahomigie 

Peach Springs Elementary School District No. 8 
P.O. Box 138 v V 

Peach Springs, A2 86*3* ; , . 
Phone: (602) 769-2202 



2. Borr^go Pass, School Navajo Prof iciency Assessment 

Contact person: William JvKniseley 1 

' ; Borrego Pass School 

P.O. Drawer A • 
Crownpoint, NM 87313 
Phone: (505)786*5237 

3. The Window Rock Of al Language Test 
Navajo/English Bilingual Proficiency 



Contact person: 



Marie Arviso 
Window Rock School District No. 8 
P.O. Box 559 
Ft. Defiance, AZ 8650* 
Phone: (602) 729-5705 



REFERENCE NOTES 1; 



The Proficiency Scale was tcticen from the Window Rock Oral ^Language Test ; 
which was also adapted from the Foreign Service Institute (F5l); * i 

• * ■ ? • • > 

The Guidelines for Developing. New Instruments were adapted f rani the Language 
■'■ Assessment Manual, Resources for Developing a Student Placement System for 
Bilingual Programs, Southwest Regibn^d Laboratory for Educational Research 
and Development in Los Alamitos, CA° 9J072O. ■ 

. ■ .. . "; , t . - • ;' : .^v ..V; .:• ' • •. 

Some information included in Establishing a Language Data Base was excepted 
and adapted; from an unpublished nlanusjcript of the Native American Materials 
Development Center iaAlbuqueirc^e,i^w Mexico. 
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